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Introduction 

Let A g be the moduli space of principally polarized abelian varieties of di- 
mension g. Over the complex numbers A g = M g /T g where M g is the Siegel 
space of genus g and T g = Sp(2g,Z). We denote the torodial compacti- 
fication given by the second Voronoi decomposition by A* and call it the 
Voronoi compactification. It was shown by Alexeev and Nakamura [lAj that 
A* coarsely represents the stack of principally polarized stable quasiabelian 
varieties. The variety A* is projective @ and it is known that the Picard 
group of A*, g > 2 is generated (modulo torsion) by two elements L and D, 
where L denotes the (Q-)line bundle given by modular forms of weight 1 
and D is the boundary (see pu2] , [Q and pulR for g = 2, 3 and > 4). In 



this paper we want to discuss the following 

Theorem 0.1 Let g = 2 or 3. A divisor aL — bD on A* g is nef if and only 
ifb>0 and a - 12b > 0. 

The varieties A g have finite quotient singularities. Adding a level-n 
structure one obtains spaces A g (n) = M g /T g (n) where T g (n) is the princi- 
pal congruence subgroup of level n. For n > 3 these spaces are smooth. 
However, the Voronoi compactification A* g {n) acquires singularities on the 
boundary for g > 5 due to bad behaviour of the second Voronoi decomposi- 
tion. There is a natural quotient map A* g {n) — > A* g . Note that this map is 



branched of order n along the boundary. Hence Theorem (CK1) is equivalent 
to 

Theorem 0.2 Let g = 2 or 3. A divisor aL — bD on A* g {n) is nef if and 
only ifb>0 and a - 12^ > 0. 

This theorem easily gives the following two corollaries. 
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Corollary 0.3 If g = 2 then K is nef but not ample for A^i^) and K is 
ample for A^in), n > 5; in particular A^in) is a minimal model for n > 4 
and a canonical model for n > 5. 



This was first proved by Borisov [Bo 



Corollary 0.4 If g = 3 then K is nef but not ample for .4,3(3) and K is 
ample for A%(n), n > 4; in particular A^(n) is a minimal model for n > 3 
and a canonical model for n > 4. 



In this paper we shall give two proofs of Theorem ( |0.1| ). The first and 
quick one reduces the problem via the Torelli map to the analogous question 
for M2, resp. M3. Since the Torelli map is not surjective for g > 4 this proof 
cannot possibly be generalized to higher genus. This is the main reason why 
we want to give a second proof which uses theta functions. This proof makes 
essential use of a result of Weissauer |Wej ]. The method has the advantage 
that it extends in principle to other polarizations as well as to higher g. We 
will also give some partial results supporting the 

Conjecture For any g > 2 the nef cone on A* g is given by the divisors 
oL - bD where b > and a - 126 > 0. 
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1 Curves meeting the interior 

We start by recalling some results about the Kodaira dimension of A* g {n). 
It was proved by Freitag, Tai and Mumford that A* is of general type for 
g > 7. The following more general result is probably well known to some 
specialists. 

Theorem 1.1 A* g {n) is of general type for the following values of g and 
n > no-' 
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Proof. One can use Mumford's method from [Mul|. First recall that away 
from the singularities and the closure of the branch locus of the map M g — ► 
A g (n) the canonical bundle equals 

K = (g + l)L-D. (1) 

This equality holds in particular also on an open part of the boundary. If g < 
4 and n > 3 the spaces A*(n) are smooth and hence (|]) holds everywhere. If 
g > 5 then Tai [[I] showed that there is a suitable toroidal compactification 
A g (n) such that all singularities are canonical quotient singularities. By 



Mumford's results from [Mul] one can use the theta-null locus to eliminate 



D from formula (|l|) and obtains 

/ o g ~ 2 (2 9 4- ~\)\ 1 

'< - (to + 1) - J 2 ,-t l ) i + P) 

We then have general type if all singularities are canonical and if the factor 
in front of L is positive. This gives immediately all values in the above 
table with the exception of (g,n) = (4,2) and (7,1). In the latter case 
the factor in front of L is negative. The proof that A-j is nevertheless of 
general type is the main result of [Mul]. The difficulty in the first case is 



that one can possibly have non-canonical singularities. One can, however, 
use the following argument which I have learnt from Salvati Manni: An 
immediate calculation shows that for every element a € T 9 (2) the square 
cr 2 G T 9 (4). Hence if a has a fixed point then a 2 = 1 since T ff (4) acts freely. 
But for elements of order 2 one can again use Tai's extension theorem (see 
jlj Remark after Lemma 4.5] and ffl Remark after Lemma 5.2]). □ 



Remark 1.2 The Kodaira dimension of Aq is still unknown. All other 
varieties A g (n) which do not appear in the above list are either rational 
or unirational: Unirationality of A g for g = 5 was proved by Donagi O 
and by Mori and Mukai [MM]. For g = 4 the same result was shown by 
Clemens [Q. Unirationality is easy for g < 3. Igusa Q showed that A2 is 
rational. Recently Katsylo [Ka] proved rationality of .M3 and hence also of 
.A3. The space A3 (2) is rational by work of van Geemen [vG\ and Dolgachev 
and Ortlang | DO| . A2(3) is the Burkhardt quartic and hence rational. This 
was first proved by Todd (1936) and Baker (1942). See also the thesis of 
Finkelnberg |FJ. The variety .4,2(2) has the Segre cubic as a projective 
model ] ydGl| ] and is hence also rational. Yamazaki [Ya] first showed general 
type for A.2(n), n > 4. 
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We denote the Satake compactification of A g by A g . There is a natural 
map 7r : A* — > A g which is an isomorphism on A g . The line bundle L is 
the pullback of an ample line bundle on A g which, by abuse of notation, 
we again denote by L. In fact the Satake compactification is defined as the 
closure of the image of A g under the embedding given by a suitable power 
of L on A g . In particular we notice that L.C > for every curve C on A g 
and that L.C > if C is not contracted to a point under the map ir. 

Let F be a modular form with respect to the full modular group 
Sp(2<7, Z). Then the order o(F) of F is defined as the quotient of the van- 
ishing order of F divided by the weight of F. 

Theorem 1.3 (Weissauer) For every point r € M g and every e > there 
exists a modular form F of order o(F) > which does not vanish at r. 



Proof. See JW§. □ 



Proposition 1.4 Let C C A* be a curve which is not contained in the 
boundary. Then (aL — bD).C > ifb>0 and a — 12b > 0. 

Proof. First note that L.C > since 7r(C) is a curve in the Satake com- 
pactification. It is enough to prove that (aL — bD).C > if a — 12b > 
and a, b > 0. This is clear for 6 = and hence we can assume that b ^ 0. 
We can now choose some e > with a/b > 12 + e. By Weissauer's theorem 
there exists a modular form F of say weight k and vanishing order m with 
F(t) 7^ for some point [r] £ C and m/k > 1/(12 + e). In terms of divisors 
this gives us that 

kL = mD + D F , C <£ D F 
where Dp is the zero-divisor of F. Hence 

( —L — D) = —D F .C>0. 
\m ) m 

Since a/b > 12 + e > k/m and L.C > we can now conclude that 

&L-D) .C>(^L-D 
V b J \m 

□ 



).C>0. 
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Remark 1.5 Weissauer's result is optimal, since the modular forms of order 

> 1/12 have a common base locus. To see this consider curves C in A* of the 
form X(l) x {A} where X(l) is the modular curve of level 1 parametrizing 
elliptic curves and A is a fixed abelian variety of dimension g— 1. The degree 
of L on X(l) is 1/12 (recall that L is a Q-bundle) whereas it has one cusp, 
i.e. the degree of D on this curve is 1. Hence every modular form of order 

> 1/12 will vanish on C. This also shows that the condition a — 12b > is 
necessary for a divisor to be nef. 



2 Geometry of the boundary (I) 

We first have to collect some properties of the structure of the boundary of 
A g (n). Recall that the Satake compactification is set-theoretically the union 
of A g (n) and of moduli spaces Ak(n), k < g of lower dimension, i.e. 



A g {n) = A g (n) II (g^jLi(n)) U (n^*)) . . . H (lI4i, 9 (» 
Via the map tt : A* g {n) — > A g (n) this also defines a stratification of A g (n): 
A* g (n) = A g (n) II (ni£_i(n)) II (uD^ 2 (n)^j . . . II (iLD^O 



The irreducible components of the boundary D are the closures D g _ 1 (n) 
of the codimension 1 strata D g 1 _ 1 (n). Whenever we talk about a boundary 

component we mean one of the divisors Then the boundary D is 

given by 

h 

The fibration tt : D g 1 _ 1 (n) — > ^^(n) = ^4 9 _i(n) is the universal family 
of abelian varieties of dimension g — 1 with a level-n structure if n > 3 



resp. the universal family of Kummer surfaces for n = 1 or 2 (see [ Mul[| ). 
We shall also explain this in more detail later on. To be more precise we 
associate to a point r € M g the lattice L T> \ = (r, l)Z 2s , resp. the principally 
polarized abelian variety A T i = C 9 /L T ±. Given an integer n > 1 we set 
L nT ,n = (nT,nl g )Z 29 , resp. A nT , n = C 9 /L nTi „. By K nT , n we denote the 
Kummer variety A n ^ n j '{±1}. 

Lemma 2.1 Let n > 3. T/ien /or any point [r] G A g x _i(ri) the fibre of tt 
equals 7r _1 ([r]) = A n ^ Tn . 
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Proof. Compare [Mul|. We shall also give an independent proof below. □ 



This result remains true for n = 1 or 2, at least for points r whose 
stabilizer subg roup in T^g(ri) is {il}, if we replace A n ^ rn by its associate 
Kummer variety K n ^ Tn . 

Lemma 2.2 Let n>3. Then for [r] E A^^n) the restriction o/Z)* 1 _ 1 (n) 
to the fibre 7t -1 ([t]) is negative. More precisely 

2 

D a-i(P>)\*-H[T]) = ~-H 

where H is the polarization on A nT ^ n given by the pull-back of the principal 
polarization on A T \ via the covering A n ^ Tn — > A T \. 



Proof. Compare [Mul, Proposition 1.8], resp. see the discussion below. □ 



Again the statement remains true for n = 1 or 2 if we replace the abelian 
variety by its Kummer variety. 



First proof of Theorem (0.1). We have already seen (see Remark |1.5| ) that 
for every nef divisor aL — bD the inequality a — 12b > holds. If C is a 
curve in a fibre of the map A*(n) — > A g (n), then L.C = 0. Lemma (|2.2|) 
immediately implies that b > for any nef divisor. It remains to show that 
the conditions of Theorem (p.l[) are sufficient to imply nefness. For any 



genus the Torelli map t : A4 g — > A g extends to a morphism t : M. g — > A* 
(see [Nam]). Here M. g denotes the compactification of M. g by stable curves. 



For g = 2 and 3 the map t is surjective. It follows that for every curve C 
in A* there is a curve C in M. g which is finite over C. Hence a divisor on 
A g , g = 2, 3 is nef if and only if this holds for its pull-back to M g . In the 
notation of Faber's paper jFaJ t L = A where A is the Hodge bundle and 
t D = do where 5q is the boundary (g = 2), resp. the closure of the locus 



of genus 2 curves with one node (g = 3) (cf also [vdG2|). The result follows 
since aX — bdo is nef on Ai g , g = 2, 3 for a — 12b > and b > (see [pa[|). □ 

As we have already pointed out the Torelli map is not surjective for g > 4 
and hence this proof cannot possibly be generalized to higher genus. The 



main purpose of this paper is, therefore, to give a proof of Theorem (0.1) 
which does not use the reduction to the curve case. This will also allow us to 
prove some results for general g. At the same time we obtain an independent 
proof of nefness of aX — b5o for a — 12b > and b > on A4 g for g = 2 and 
3. 
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We now want to investigate the open parts D l }-_^{n) of the boundary 



more closely. At the 



components D g _i(n) and their fibration over A g ~i(n) 
same time this gives us another argument for Lemmas fl2.ip and ( |2.2[ ). At 
this stage we have to make first use of the toroidal construction. Recall that 
the boundary components Z)* 1 _ 1 (n) are in 1 : 1 correspondence with the 
maximal dimensional cusps, and these in turn are in 1 : 1 correspondence 
with the lines I C Q 9 modulo T g (n). Since all cusps are equivalent under 
the action of T g /T g (n) we can restrict our attention to one of these cusps, 
namely the one given by Iq = (0, . . . , 0, 1). This corresponds to r gg — > ioo. 
To simplify notation we shall denote the corresponding boundary stratum 



simply by Dl 



n 



D n 



The stabilizer P(lo) of Iq in T g is generated 



by elements of the following form (cf. [ [HKW , Proposition 1.3.87]): 
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We write r = (Tij)i<i,j< g in the form 
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Then the action of P(l ) on M 9 is given by (cf. IjHKWj 1.3.91]): 



, (An + B^Cn + D)- 1 



n * 

±r 2 r 3 ; ' 



52 (t) 

53 (t) 

where = r 3 + Mri *M +M V 2 + *( M V 2 ) + iV* M, 



T\ * 
T 2 + M Tl + N 



n T 2 

T2 T 3 + S 



The parabolic subgroup P(lo) is an extension 

1 — P'(Zq) — » P(/ ) — f'tfo) — 1 

where P'(lo) is the rank 1 lattice generated by 54. To obtain the same result 
for T g (n) we just have to intersect P(lo) with T g (n). Note that 52 is in 
T g (n) only for n = 1 or 2. The first step in the construction of the toroidal 
compactification of A*(n) is to divide M g by P'(Iq) HF(ri) which gives a map 



T2 T3 



1 X Cf" 1 X C* 
ri,r 2 ,e 2 ^/n). 



Partial compactification in the direction of Iq then consists of adding the set 
H 9 _i x C s_1 x {0}. It now follows immediately from the above formulae 
for the action of P{Iq) on M g that the action of the quotient group P"(lo) 
on H 9 _i x C 9 ' 1 x C* extends to H g _i x C 9 " 1 x {0}. Then A,-l( n ) = 
(H 5 _i x <C 9 ~ l ) / P" and the map to «4 g _i(n) is induced by the projection 
from H 9 _i x C 9_1 to H 9 _i. This also shows that D s _i(n) — ► ^4 9 _i(n) is the 
universal family for n > 3 and that the general fibre is a Kummer variety 
for n = 1 and 2. 

Whenever n\\n 2 we have a Galois covering 

7r(ni,n 2 ) : ^(n 2 ) — > ^(ni) 

whose Galois group is T g {n\) /T g (n 2 ) . This induces coverings Z? 9 _i(n 2 ) — ► 
D g -\{n{), resp. -D 9 _i(n 2 ) — ► D g -i(n{). In order to avoid technical diffi- 
culties we assume for the moment that A g (n) is smooth (this is the case if 



S 



g < 4 and n > 3). In what follows we will always be able to assume that 
we are in this situation. Then we denote the normal bundle of Z? g _i(n) in 
Ag(n) by N-p _ resp. its restriction to D g ^\(n) by N Dg _ 1 ^ n y Since the 
covering map 7r (711,712) is branched of order n 2 jn\ along the boundary, it 
follows that 

We now define the bundle 

M(n) : =-nNn g _ i{n) +L. 

This is a line bundle on the boundary component D s _i(n). We denote the 
restriction of M(n) to D g -i{n) by M(n). We find immediately that 

7r*(ni,n 2 )M(ni) =M(n 2 ). 

The advantage of working with the bundle M(n) is that we can explicitly 
describe sections of this bundle. For this purpose it is useful to review some 
basic facts about theta functions. For every element m = (m', m") of M 29 
one can define the theta-function 

@ m , m „(r,z) = V e 27ri [('?+ m ')^(g+™')/2+(< ? + m ') t ( z +m")] > 

The transformation behaviour of 0m'm"( r > z ) with respect to z 1— > z + ut + u' 
is described by the formulae (Ol)-(05) of 0, pp. 49, 50]. The behaviour 
of ® m 'm"{T, z) with respect to the action of T g (l) on M g x C 9 is given by 
the theta transformation formula [ilj, Theorem II. 5. 6] resp. the corollary 
following this theorem p], p. 85]. 

Proposition 2.3 iei n = 0mod4p 2 . If m! ,m" ,fn' ,fn" € -^L 9 ^ 1 , then the 
functions Q m i m " (t, z)Q m ' m " (t, z) define sections of the line bundle M(n) on 
D g -i{n). 

Proof. It follows from (03) and (01) that for k, k' € nZ, 9 " 1 the following 
holds: 

@ m ',m"(r, z + kr + k') = e 2m ^ krtk - kt ( z+k 'VQ m , >m „(T, z). 

Similarly, of course, for Q m r m /i (r, z) . Moreover the theta transformation 
formula together with formula (02) gives 

e m >,m»(T # , z*) = e ™[\*iPT+D)-Wz\ det{Cr + D)i/2 u e ro , )m/ ,( Tj Z ) 
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for every element 7=1^ f! ) £ ^g-l( n ) an d 



C D / 

T # = 7 (r), z* = z(Ct + D)-\ 

Here u 2 is a character of r s _i(l, 2) with u 2 \r _ 1 u\ = 1. 

On the other hand the boundary component D g —\(n) is defined by = 
with £3 = e 27TlT 3/ n _ We have already described the action of P"(Iq) on 
H 9 _i x C s_1 . The result then follows by comparing the transformation 
behaviour of (£3/^3)™ with respect to g\ and 53 with the above formulae 
together with the fact that the line bundle L is defined by the automorphy 
factor det(Cr + L>) . □ 



This also gives an independent proof of Lemma (|2.2| ). 

3 Geometry of the boundary (II) 

So far we have described the stratum D g -\(n) of the boundary component 
D g -i(n) and we have seen that there is a natural map D g —\(n) — > A g -i{n) 
which identifies D„_i(n) with the universal family over A g -i(n) if n > 3. 
We now want to describe the closure D g -i(n) in some detail. In order 
to do this we have to restrict ourselves to g = 2 and 3. First assume 
g = 2. Then the projection D\(n) — > A\(n) = X°(n) extends to a projection 
D\(n) — > X(n) onto the modular curve of level n and in this way D\{n) is 
identified with Shioda's modular surface S(n) — > X(n). The fibres are either 
elliptic curves or n-gons of rational curves (if n > 3). Similarly the fibration 
D2(n) —> A2(n) extends to a fibration D2(n) — > A2 whose fibres over the 
boundary of A^n) are degenerate abelian surfaces. This was first observed 
by Nakamura paH ] and was described in detail by Tsushima [Ts] whose 
paper is essential for what follows. 

We shall now explain the toroidal construction which allows us to de- 
scribe the fibration D2(n) — > A^n) explicitly. Here we shall concentrate 
on a description of this map in the most difficult situation, namely in the 
neighbourhood of a cusp of maximal corank. 

The toroidal compactification A g (n) is given by the second Voronoi de- 
composition Ti g . This is a rational polyhedral decomposition of the con- 
vex hull in Sym^°(IR) of the set Sym^°(Z) of integer semi-positive (g x g)- 
matrices. For g = 2 and 3 it can be described as follows. First note that 
Gl(p,Z) acts on Sym|°(R) by 7 ^ t MjM. For g = 2 we define the stan- 
dard cone 

02 = M>q7i + M>o72 + K>o73 
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£ 2 = {M(<r 2 ); M € G1(2,Z)}. 
Similarly for 51 = 3 we consider the standard cone 

a 3 = R> oai + M> a 2 + M> a 3 + ^>oPi + ^>o/?2 + ^>ofo 

with 



a 2 = U 1 U , a 3 





02 = , A 




Then 



£ 3 = {M(cr 3 ); M€G1(3,Z)}. 
We consider the lattices 

iV 3 = Z71 + z 72 + z 73 

iV 6 = Zai + Za 2 + Za 3 + Zft + Z/% + Z/%. 

The fans S 2 resp. S 3 define torus embeddings T 3 C X(S 2 ) and T 6 C X(S 3 ). 
We denote the divisors of JT(£ 3 ) which correspond to the 1-dimensional sim- 
plices of S 3 by D i . Let T> = T) 1 be the divisor corresponding to M>oa 3 . An 
open part of V (in the C-topology) is mapped to the boundary component 
D2 (n) . In order to understand the structure of V we also consider the rank 
5 lattice 

iV 5 = Zai + Za 2 + Z/3i + Z/3 2 + Z/3 3 N 6 /Za 3 . 

The natural projection p : Nq^ — ► ^5,R maps the cones of the fan E 3 to 
the cones of a fan £3 C N^r. This fan defines a torus embedding T 5 = 
(V \U^)C X(E 3 ) = P. 

The projection 

A: iV 6 , R Sym 3 (M) — ► iV 3iM £S Sym 2 (R) 

a 6 
6 c 
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maps S3 to £2 and factors through A^r. In this way we obtain an induced 
map 

V = X(X> 3 ) — X(£ 2 ) 

u u 

In order to describe this map we first consider the standard simplices 03 C 
A^r and 02 C A^r, resp. a' 3 = p(<Jz) C A^r. On the torus T 6 (and 
similarly on T 5 and T 3 ) we introduce coordinates by 

tij = e 2 ™ Ti i/ n (1 < i, J < 3). 

These coordinates correspond to the dual basis of the basis U*j of Sym(3, Z) 
where the entries of U*- are 1 in positions and and otherwise. 
One easily checks that T as = C 6 C X(E^) and as coordinates on Tfj~ one can 
take the coordinates which correspond to the dual basis of the generators 
ai, . . . , fy. Let us denote these coordinates by Ti, . . . ,Tq. A straightforward 
calculation shows that the inclusion T 6 C T CT3 is given by 

T\ = *n*i3*i2, Ti = £22*23*12, T3 = £33*13*235 /-.n 

7"> i— 1 J.— 1 rp f — 1 V / 

Then P n T CT3 = {T3 = 0}. For genus 2 the corresponding embedding 
T 3 C T CT2 is given by 



Ti — *H*12, T2 — *22*12, T3 — i 
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Finally we consider T CT / = C 5 C X(£ 3 ). The projection P = X(£ 3 ) — > 
X(S2) map T CT / to T CT2 . We can use Ti, T 2 , T4, T5, T^ as coordinates on T CT /. 
Since A(ai) = A (^2) = 7ij A(a 2 ) = A(/3i) = 72 and A(c*3) = 73 we find that 



T„, ^ C 5 — ► T a2 ^ C 3 



'3 



(Ti,T 2 ,T4,T 5 ,T 6 ) 1 — > (T1T5, T 2 T 4 , T 6 ). 



(2) 



Given any (maximal dimensional) cone a 1 = p(a) in £ 3 we can describe the 
map T a > — > Tx^) in terms of coordinates by the method described above. In 
this way we obtain a complete description of the map V — > X(£2)- 

Let us now return to the toroidal compactification .4 3 (n) of ^(n). Let 
no C Q 6 be a maximal isotropic subspace. Then we obtain the compactifi- 
cation of ^3 (n) in the direction of the cusp corresponding to uq as follows: 
The parabolic subgroup P(uq) C ^(n) is an extension 

1 — > P'(no) — > P(«o) — > P"(«o) — > 1 
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where P'(uq) is a lattice of rank 6. We have an inclusion H g /P'(uo) C T 6 C 
X(Ti3) and we denote the interior of the closure of M g /P'(uo) in X(Y,3) by 
X(uq). Then P"{uq) acts on X(uq) and we obtain a neighbourhood of the 
cusp corresponding to uq by X{uq)/P"{uq). We have already described the 
partial compactification in the direction of a line (in our case Iq). Similarly 
we can define a partial compactification in the direction of an isotropic 
plane ho. The space A%(n) is then obtained by glueing all these partial 
compactifications. 

The result of Nakamura and Tsushima can then be stated as follows: 
The restriction of the map tt : A%(n) — > Az{n) to the boundary component 
D2(n) admits a factorisation 

D 2 (n)^A* 2 (n) 




A 2 (n) 

where tt" : A 2 (n) — > A 2 (n) is the natural map of the Voronoi compacti- 
fication A 2 {n) of A 2 (n) to the Satake compactification A 2 (n). The map 
tt' : D 2 (n) — ► -4,2( n ) i s a family of surfaces extending the universal fam- 
ily over A 2 (n). In order to describe the fibres over the boundary points of 
A 2 (n) recall that every boundary component of A 2 (n) is isomorphic to the 
Shioda modular surface S(n). We explain the type of a point P in A 2 (n) as 
follows: 

P has type I <^=> P <G A 2 (n) 

P has type II -<==>- P lies on a smooth fibre of 

a boundary component S(n) 
P has type Ilia <==^> P is a smooth point on a singular 

fibre of S(n) 

P has type Illb ^=^> P is a singular point of an n-gon 

in S{n). 

Points of type Illb are also often called deepest points. 

Proposition 3.1 (Nakamura, Tsushima) Assume n > 3. Let P be a 

point in A 2 {n) and denote the fibre of the map tt' : D 2 (n) — > A 2 (n) over P 
by Ap. Then the following holds: 

(i) If P = [t] G A 2 (n) is of type I i/ien Ap is a smooth abelian surface, more 
precisely Ap = A n)Tn . 

(ii) i/P is of type II, i/ten ^4p is a cyc/e o/n elliptic ruled surfaces. 
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(iii) If P is of type Ilia, then Ap consists on n 2 copies o/P 1 x P 1 . 

(iv) If P is of type Illb, then Ap consists of 2>n 2 components. These are 2n 2 
copies of the projective plane P 2 and n 2 copies o/P 2 , i.e. P 2 blown up in 3 
points in general position. 

Proof. The proof consists of a careful analysis of the map I?2( n ) ~~ * -^(n) 
using the description of the map T> — » X(T,2). For details see |fT^ , section 
4]. □ 

Remarks (i) The degenerations of type Ilia and Illb are usually depicted 
by the diagrams 



(Ilia) 



where each square stands for a P 1 x P 1 , resp. 
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(ii) The singular fibres are degenerate abelian surfaces (cf. | ]Nak ], [ HK W| ) 



(hi) This description must be modified for n = 1 or 2. Then the general 
fibre is a Kummer surface K nTn and the fibres of type (Illb) consist of 8 
(n = 2), resp. 2 copies of P 2 . 

The following is a crucial technical step: 

Proposition 3.2 Let n = 0mod8p 2 . If m f ,m" ,m' ,m" 6 ^-1? then the 
sections Q m 'm"( T i z )®m'm"{ T > z ) of the line bundle M(n) on D^in) extend 
to sections of the line bundle M(n) on D^n). 

Proof. We have to prove that the sections in question extend to the part 
of D2(n) which lies over the boundary of A^n). This is a local statement. 
Moreover it is enough to prove extension in codimension 1. Due to sym- 
metry considerations we can restrict ourselves to one boundary component 
in .4-2 (n). We shall use the above description of the toroidal compactifica- 
tions A%{n) and A%(n) and of the map D2{n) —> A%{n). We consider the 
boundary component of A^n) given by {T2 = 0} C T CT2 C X(E2). Recall 
the theta functions 

&m'm"(T,z) = S2 e 27ri [|('? +m ') Tt fe+ m ')+(g+m') t (2W)] 
q&? 

In our situation 

T=[ n ) , Z = (Z 1 ,Z 2 ) = (t 13 ,T 23 ). 

V r 12 722/ 

In level n we have the coordinates 

. _ 2TTiTij/n 
l 3 — 

and Q m ' m " (t, z) becomes 

„ / \ _ Aiqi+m'^n (q 1 +m' 1 )(q 2 +m' 2 )n Uq 2 +m' 2 ) 2 n 

^m'm" V) Z) — / J En £12 E 22 

<?=(<?l.'?2)GZ 2 

Aqi+m'^n (q 2 +m' 2 )n 2m(q+m'yrn'' 
l 13 5 23 e 

We use the coordinates Ti, T2, T4, T5, T$ on T a i . It follows from (|l|) that 

til = TiTqTq, t22 = T2T4TQ, 

*23 = T 4 , t\3 = T 5 , (3) 
h2 = Tq 1 . 
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This leads to the following expression for the theta-functions 



r> ( \ rpltei+mi) 2 " rpk^+m'^n ±(q 2 +m 2 )(q 2 +m 2 -2)n 

Vm / m"{T,Z) = 1 1 1 2 1 i 

qei? 

|(gi+m' 1 )( gi +m' 1 -2)n ^({q 1 +m / 1 )-{q 2 +m' 2 )) 2 n 2m(q+m') t m" 

J 5 J 6 e . 

By (|2|) the locus over T 2 = C T a2 in T a < is given by T 2 T 4 = 0. The equation 
for the boundary component D2(n) is given by £33 = 0. Since by (|l|) we 
have £33 = T3T4T5 we can assume that the normal bundle and hence M(n) 
(more precisely its pullback to X(S 3 )) is trivial outside T4T5 = 0. Since the 
exponent of T 2 is a non-negative integer (here we use n = 0mod8p 2 ) this 
shows that the sections extend over T 2 = 0, T4 7^ 0. To deal with the other 
components of Tjv which lie over {T 2 = 0} in T a2 we use the matrices 



(n, m G 




(cf. fr"s|| ) which act on Symj°(Z) by 



Via A this action lies over the trivial action on Sym^°(Z). This action also 
factors through p. Let (<7 3 ) nm = p{ t v n m^'iV nrn ). We can then either argue 
with the symmetries induced by this operation or repeat directly the above 
calculation for T^ a ^ nm . Acting with vom, m £ 7*, we can thus treat all 
components in X(E 3 ) lying over {T 2 = 0} in X(E 2 ). □ 



4 Curves in the boundary 

We can now treat curves contained in a boundary component. The following 



technical lemma will be crucial. Its proof uses the ideas of [We, Abschnitt 4] 
in an essential way and it can be generalized in a suitable form to arbitrary g. 
We consider the boundary component D 2 (n) which belongs to the line Iq = 
(0, . . . , 0, 1) C Q 6 . Recall that the open part -D 2 (n) of D 2 (n) is of the form 
D 2 {n) =C 2 xi 2 /(P"(I )nr(n)) and that the group P"(l )/(P"(l )nT(n)) 
acts on D 2 (n). Recall also the fibration n' : .D 2 (n) — ► .A 2 (n). We shall 
denote the boundary of *4 2 (n) by B. 
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Proposition 4.1 Let (z,t) G C 2 x H2. For every e > there exist integers 
n,k and a section s G H°(M(n) k ) such that 

(i) s{[z,t}) where [z,t] G D 2 (n) = C 2 x i 2 /(P"(I ) n r(n)), 

(ii) s vanishes on tt*B of order A with ^ > 12 "^ £ . 

Proof. Let p > 3 be a prime number (which will be chosen later). For 
I = 2p we consider the set of characteristics M in (yZ/Z) 6 of the form 
m = (m p ,m 2 ) in (|Z/Z) 6 © (^Z/Z) 6 with m p £ Z 6 . The group r 3 (l) acts 

on M. with 2 orbits. Assume e > is given and that M. is a subset of A4 
with 

#A4 < e#M. 

Then set 

@ mM T >^= \{ym(r,z). 
m&M\M 

Let n = 8p 2 . By Proposition ( p 7 ^ ) the functions 0^ n (r, z) define sections in 
M(n) p . Let Mi, . . . ,M N G r 2 (l) be a set of generators of r 2 (l)/T 2 (n) ^ 
Sp(4, Z/nZ). Then Mi, . . . , Mat, considered as elements in P(lo), act on the 
line bundle M(n). We set 



N 

M,M 



F r (T,z) = Y,M*0 

i=l 

This is a r2/T2(n)-invariant section of M(n) pr . 

Now consider the abelian surface A = A T) \ = C 2 /(Z 2 t + Z 2 ). Then 
A nT , n = C 2 /((nZ) 2 r + (nZ) 2 ) is the fibre of 7r over the point [t] G ^(n). 
Let _ 

M = {m G M; 9 m (r,z) = 0}. 

The argument of Weissauer shows that 

#A4 < e#A4 

for p sufficiently large. For some r the section F r (T, z) does not vanish at 
[z,t] G D2(n). Let B' be a boundary boundary component of A^n). The 
inverse image D' of i?' under ir' consists of several components. Using the 
matrices u nm which were introduced in the proof of Proposition ( |3.2j ) one 
can, however, show that the vanishing order of the sections O^r, z) on the 



components of D' only depends on B' . Hence one can argue as in [We] and 



finds that the vanishing order along tt*B goes to as p goes to infinity. 
Setting k = pr this gives (ii). □ 
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We can now start giving the proof of Theorem (p.ip. Let 



H = aL — bD b > 0, 12a - - > 

n 



be a divisor on A*(n). In view of Proposition ( |1.4[) it remains to consider 
curves C which are contained in the boundary. To simplify notation we 
write the decomposition of the boundary D as 



N 
i=l 

where N = N(n, g) can be computed explicitly. Then 

-bDU(n)y (4) 



D g -i(.n) 

Now let g = 2 or 3 where we have the fibration 

tt' — ►.4*_i(n). 

We shall denote the boundary of »4g_ 1 (n) by 1?. Also note that the restric- 
tion of L to the boundary equals tt'*L_^* ^ where we use the notation L 
for both the line bundle on A* g {n) and ^4*_ 1 (n). Thus we find that 

In view of the definition of the line bundle M{n) this gives 



Proof of Theorem \0-1\ ) for g = 2. In this case the boundary components 
D\(n) are isomorphic to Shioda's modular surface S(n) and the projection 
7r' is just projection to the modular curve X(n). The degree of L on X(l) 
is j2 and we have one cusp. Hence 



deg X (n)(aL - bB) = fj,(n) - ^\ 



where /u(n) is the degree of the Galois covering X(n) — ► X(l), i.e. fi(n) = 
|PSL(2,Z/nZ)|. This is non-negative if and only if a - 12^ > 0. The 
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normal bundle of D\(n) can also be computed explicitly. This can be done 
as follows: Using the degree 10 cusp form which vanishes on the reducible 
locus one finds the equality 10L = 2H\ + D on A% where H\ is the Humbert 
surface parametrizing polarized abelian surfaces which are products. Hence 
we conclude for the canonical bundle on -4-2 (n) that K = (3 — + \H\. 

The restriction of the divisor H\ to a boundary component D l (n) = S(n) is 
the sum of the n 2 sections of S(n). The canonical bundle of the surfaces 
S(n) is equal to the pull-back via ir' of 3L minus the divisor of the cusps on 
the modular curve X(n) (see also |BH| ]). Hence adjunction together with an 
easy calculation gives 

-nDi(n)| s , (n) = 2ir'*L x(n) + 2 J^Z, - 

Since L^jl^. = —L X ( n ) one sees immediately that this line bundle is nef and 
positive on the fibres of ir' : S(n) — > X(n). The result now follows directly 
from (|). □ 

We shall now turn to the case g = 3. As we have remarked before it 
remains to consider curves which are contained in the boundary of A^(n). 
Among those curves we shall first deal with curves whose image under the 
map ir' meets the interior of A.2{n). 

Proposition 4.2 Let H = aL — bD be a divisor on A^(n) with a — 12^ > 0, 
b > 0. For every curve C in a boundary component D2(n) with vr'(C) PI 
A.2(n) ^ the intersection number H.C > 0. 



Proof. We shall use (|6|) and Proposition ( |4.1| ). If we replace n by some 
multiple and consider the pull-back of H the coefficient b/n is not changed. 
The inverse image of C may have several components. All of these are, 
however, equivalent under some finite sympectic group and it is sufficient 
to prove that the degree of H is positive on one (and hence on every) com- 
ponent lying over C. After this reduction we can again assume that C is 



irreducible and by Proposition (4.1) we can find for every e > a divisor C 
not containing C with 



By 



k ~ 12 + e 



ff fcw = "'U-;) £ -'( I -s) B ) + s c - 
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The assertion follows from the corresponding result for g = 2 provided 

(a--)- 12- ( 1 - 4" ] > ( a - 12- ) - - (1 - — — ] > 0. 

\ n J n \ nk J \ n J n \ 12 + e J 

Since a — 12b /n > this is certainly the case for e sufficiently small. □ 

We are now left with curves in the boundary of A^(n) whose image 
under ir' is contained in the boundary of A^ip). These are exactly the 
curves which are contained in more than 1 boundary component of A^(n). 
Before we conclude the proof, we have to analyze the situation once more. 
First of all we can assume by symmetry arguments that C is contained in 
D 2 (n)=-D 2 ( n )- Let B' be a component of the boundary B of A^in) which 
contains ir'(C). Let D' = (-7r / ) _1 (i? / ). Then D' consists of n irreducible 
components and we have the following commutative diagram (n > 3): 

D\{n)^^Al(n) 
U U 
D' ^ B' S(n) 

X(n). 

Altogether there are three possibilities: 

(1) 7r'(C) = pt, i.e. C is contained in a fibre of it' . 

(2) 7r(C) = pt, vr'(C) 7^ pt. Then tt'(C) is either a smooth fibre of S(n) or a 
component of a singular n-gon. 

(3) 7r(C) = X(n). 

The final step in the proof of Theorem (|0.l| ) is the following: 

Proposition 4.3 Zei C C D2{n) be a curve whose image vr'(C) is contained 
in the boundary ofA^n). If H = aL—bD is a divisor with b > 0, a— 12- > 
i/ien F.C > 0. 

Proof. By induction on g and formula (||) it is enough to prove that there is 
some D J 2 (n) with C.D 3 2 {n) < 0. Consider the inverse image D' of B' under 
tt' . Then D' consists of n irreducible components each of which is of the 
form D 2 (n) PI D 2 (n) for some i ^ 1. We already know that —B'\b> is nef. 
Hence 

^S*a(«)n^(n)j .C<0 
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where / is a suitable set of indices consisting of n elements. In particular 
D 3 2 (n).C < for some index j, □ 



Remarks (i) If vr'(C) = pt, then one can give an alternative proof of 
D2(n).C > by computing the normal bundle of D2(n) restricted to the 
singular fibres of n'. The conormal bundle is ample as in the smooth case 
(cf. Lemma (|2~2|)). 

(ii) If vr'(C) ^ pt one can also use the theta functions m ' m " with m', m" G 
^Z 2 to construct sections of M(n) which, after subtracting suitable compo- 
nents of the form 7T 2 (n) f] D\(n) , do not vanish identically on C. In this way 
one can compute similarly to the proof of Proposition ( |4.2[ ) that H.C > 0. 

Proof of Theorem (0.1) (g=3). This follows now immediately from Proposi- 
tion (1.4), Proposition ( |4.2| ) and Proposition ( |4.3| ). □ 



Proof of the corollaries. These follow immediately from Theorem (0.1) since 
the moduli spaces are smooth and since 

K = (g + l)L-D. 

Obviously 

(s + D _ 12 > o « ^ " s 4 if » = 2 



n 



n > 3 if g = 3. 



Hence K is nef if g = 2, n > 4 and g = 3, n > 3, resp. numerically positive if 
9 = 2, n > 5 and g = 3, n > 4. It follows from general results of classification 
theory that K is ample in the latter case. □ 
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